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CN ' Abstract 

5-H i 

j^ , The question of how people form their opinion has fascinated economists and sociofogists 

for quite some time. In many of the models, a group of people in a social network, each 

holding a numerical opinion, arrive at a shared opinion through repeated averaging with their 

CO ■ neighbors in the network. Motivated by the observation that consensus is rarely reached in real 

opinion dynamics, we study a related sociological model in which individuals' intrinsic beliefs 

counterbalance the averaging process and yield a diversity of opinions. 

f-H I By interpreting the repeated averaging as best-response dynamics in an underlying game 

r^ ' with natural payoffs, and the limit of the process as an equilibrium, we are able to study the 

cost of disagreement in these models relative to a social optimum. We provide a tight bound on 

^ ' the cost at equilibrium relative to the optimum; our analysis draws a connection between these 

agreement models and extremal problems that lead to generalized eigenvalues. We also consider 

a natural network design problem in this setting: which links can we add to the underlying 

^ I network to reduce the cost of disagreement at equilibrium? 
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1 Introduction 

Averaging Opinions in a Social Netw^ork 

An active line of recent work in economic theory has considered processes by which a group of 
people in a social network can arrive at a shared opinion through a form of repeated averaging 
[H El [T2| [TJj . This work builds on a basic model of DeGroot [8j , in which we imagine that each 
person i holds an opinion equal to a real number Zj, which might for example represent a position 
on a political spectrum, or a probability that i assigns to a certain belief. There is a weighted graph 
G = {V, E) representing a social network, and node i is influenced by the opinions of her neighbors 
in G, with the edge weights reflecting the extent of this influence. Now, in each time step node i 
updates her opinion to be a weighted average of her current opinion and the current opinions of 
her neighbors. 

This body of work has developed a set of general conditions under which such processes will 
converge to a state of consensus, in which all nodes hold the same opinion. This emphasis on 
consensus, however, can only model a specific type of opinion dynamics, where the opinions of the 
group all come together. As the sociologist David Krackhardt has observed. 

We should not ignore the fact that in the real world consensus is usually not reached. Recognizing this, 
most traditional social network scientists do not focus on an equilibrium of consensus. They are instead 
more likely to be concerned with explaining the lack of consensus (the variance) in beliefs and attitudes 
that appears in actual social influence contexts |16) . 

In this paper we study a model of opinion dynamics in which consensus is not reached in general, 
with the goal of quantifing the inherent social cost of this lack of consensus. To do this, we first 
need a framework that captures some of the underlying reasons why consensus is not reached, as 
well as a way of measuring the cost of disagreement. 

Lack of Agreement and its Cost 

We begin from a variation on the DeGroot model due to Friedkin and Johnsen [11], which posits 
that each node i maintains a persistent internal opinion Si. This internal opinion remains constant 
even as node i updates her overall opinion Zi through averaging. More precisely, if Wij > denotes 
the weight on the edge {i,j) in G, then in one time step node i updates her opinion to be the 
average 

Si + Z^j^NU) WijZj 

^i = ~rr¥ — ' (1) 

where N{i) denotes the set of neighbors of i in G. Note that, in general, the presence of Sj as a 
constant in each iteration prevents repeated averaging from bringing all nodes to the same opinion. 
In this way, the model distinguishes between an individual's intrinsic belief Sj and her overall 
opinion Zi] the latter represents a compromise between the persistent value of Si and the expressed 
opinions of others to whom i is connected. This distinction between Sj and Zi also has parallels 
in empirical work that seeks to trace deeply held opinions such as political orientations back to 
differences in education and background, and even to explore genetic bases for such patterns of 
variation [3J. 

Now, if consensus is not reached, how should we quantify the cost of this lack of consensus? Here 
we observe that since the standard models use averaging as their basic mechanism, we can equiv- 
alently view nodes' actions in each time step as myopically optimizing a quadratic cost function: 



Updating Zi as in Equation ([T]) is the same as choosing Zj to minimize 

{zi-Sif+ ^ Wij{zi-Zjf. (2) 

We therefore take this as the cost that i incurs by choosing a given value of Zj, so that averaging 
becomes a form of cost minimization. 

Given this view, we can think of repeated averaging as the trajectory of best-response dynamics 
in a one-shot, complete information game played by the nodes in V ^ where i's strategy is a choice 
of opinion Zj, and her payoff is the negative of the cost in Equation ([2]). 

Nash Equilibrium and Social Optimality in a Game of Opinion Formation 

In this model, repeated averaging does converge to the unique Nash equilibrium of the game defined 
by the individual cost functions in (l2|): each node i has an opinion Xj that is the weighted average 
of i's internal opinion and the (equilibrium) opinions of i's neighbors. This equilibrium will not in 
general correspond to the social optimum, the vector of node opinions y that minimizes the social 
cost, defined to be sum of all players' costs: c{y) = X^. Uyi - Sif + Ylj&N{i) ^i^jiVi ~ Uj)'^) ■ 

The sub-optimality of the Nash equilibrium can be viewed in terms of the externality created 
by a player's personal optimization: by refusing to move further toward their neighbors' opinions, 
players can cause additional cost to be incurred by these neighbors. In fact we can view the 
problem of minimizing social cost for this game as a type of m,etric labeling problem [HI [15], albeit a 
polynomial-time solvable case of the problem with a non-metric quadratic distance function on the 
real numbers: we seek node labels that balance the value of a cost function at each node (capturing 
disagreement with node-level information) and a cost function for label disagreement across edges. 
Viewed this way, the sub-optimality of Nash equilibrium becomes a kind of sub-optimality for local 
optimization. 

A natural question for this game is thus the price of anarchy, defined as the ratio between the 
cost of the Nash equilibrium and the cost of the optimal solution. 

Our Results: Undirected Graphs 

The model we have described can be used as stated in both undirected and directed graphs — the 
only difference is in whether z's neighbor set N{i) represents the nodes with whom i is connected 
by undirected edges, or to whom i links with directed edges. However, the behavior of the price 
of anarchy is very different in undirected and directed graphs, and so we analyze them separately, 
beginning with the undirected case. 

As an example of how a sub-optimal social cost can arise at equilibrium in an undirected graph, 
consider the graph depicted in Figure [T] — a three-node path in which the nodes have internal 
opinions 0, 1/2, and 1 respectively. As shown in the figure, the ratio between the social cost of 
the Nash equilibrium and the social optimum is 9/8. Intuitively, the reason for the higher cost of 
the Nash equilibrium is that the center node — by symmetry — cannot usefully shift her opinion 
in either direction, and so to achieve optimality the two outer nodes need to compromise more 
than they want to at equilibrium. This is a refiection of the externality discussed above, and it is 
the qualitative source of sub-optimality in general for equilibrium opinions — nodes inove in the 
direction of their neighbors, but not sufficiently to achieve the globally minimum social cost. 

Our first result is that the very simple example in Figure [J is in fact extremal for undirected 
graphs: we show that for any undirected graph G and any internal opinions vector s, the price of 



(a) internal opinions. (b) Nash equilibrium. 




(c) optimal solution. 



Figure 1: An example in wliicli tlie two players on the sides do not compromise by the optimal amount, 
given that the player in the middle should not shift her opinion. The social cost of the optimal set of opinions 
is 1/3, while the cost of the Nash equilibrium is 3/8. 



















(a) internal opinions. (b) Nash equilibrium. (c) optimal solution. 

Figure 2: An example demonstrating that the price of anarchy of a directed graph can be unbounded. 

anarchy is at most 9/8. We prove this by casting the question as an extremal problem for quadratic 
forms, and analyzing the resulting structure using eigenvalues of the Laplacian matrix of G. From 
this, we obtain a characterization of the set of graphs G for which some internal opinions vector s 
yields a price of anarchy of 9/8. 

We show that this bound of 9/8 continues to hold even for some generalizations of the model — 
when nodes i have different coefficients Wi on the cost terms for their internal opinions, and when 
certain nodes are "fixed" and simply do not modify their opinions. 



Our Results: Directed Graphs 

We next consider the case in which G is a directed graph; the form of the cost functions remains 
exactly the same, with directed edges playing the role of undirected ones, but the range of possible 
behaviors in the model becomes very different. This is due to the fact that nodes can now exert 
a large influence over the network without being influenced themselves. Indeed, as Matt Jackson 
has observed, directed versions of repeated averaging models can naturally incorporate "external" 
media sources; we simply include nodes with no outgoing links, so that they maintain their internal 
opinion |14] . 

We first show that the spectral machinery developed for analyzing undirected graphs can be 
extended to the directed case; through an approach based on generalized eigenvalue problems we 
can efficiently compute the maximum possible price of anarchy, over all choices of internal node 
opinions, on a given graph G. However, in contrast to the case of undirected graphs, the price of 
anarchy can be very large in some instances; the simple example in Figure [2] shows a case in which 
n — 1 nodes with internal opinion all link to a single node that has internal opinion 1 and no 
out-going edges, producing an in-directed star. As a result, the social cost of the Nash equilibrium 
is 2('^ ~ 1)) whereas the minimum social cost is at most 1, since the player at the center of the 
star could simply shift her opinion to 0. Intuitively, this corresponds to a type of social network 
in which the whole group pays attention to a single influential "leader" or "celebrity"; this drags 
people's opinions far from their internal opinions Sj, creating a large social cost. Unfortunately, the 
leader is essentially unaware of the people paying attention to her, and hence has no incentive to 



modify her opinion in a direction that could greatly reduce the social cost. 

In Section [3] we show that a price of anarchy lower-bounded by a polynomial in n can in fact be 
achieved in directed graphs of constant degree, so this behavior is not simply a consequence of large 
in-degree. It thus becomes a basic question whether there are natural classes of directed graphs, 
and even bounded-degree directed graphs, for which a constant price of anarchy is achievable. 

Unweighted Eulerian directed graphs are a natural class to consider — first, because they 
generalize undirected graphs, and second, because they capture the idea that at least at a local 
level no node has an asymmetric effect on the system. We use our framework for directed graphs to 
derive two bounds on the price of anarchy of Eulerian graphs: For Eulerian graphs with maximum 
degree A we obtain a bound of A -|- 1 on the price of anarchy. For the subclass of Eulerian 
asymmetric directed graphq^ with maximum degree A and edge expansion a, we show a bound of 
0(A^a^^) on the price of anarchy. 

Our Results: Modifying the Network 

Finally, we consider an algorithmic problem within this framework of opinion formation. The 
question is the following: if we have the ability to modify the edges in the network (subject to 
certain constraints), how should we do this to reduce the social cost of the Nash equilibrium by as 
much as possible? This is a natural question both as a self-contained issue within the mathematical 
framework of opinion formation, and also in the context of applications: many social media sites 
overtly and algorithmically consider how to balance the mix of news content |2l |5l \T7\ [TS] and also 
the mix of social content ^ il9j that they expose their users to, so as to optimize user engagement 
on the site. 

Adding edges to reduce the social cost has an intuitive basis: it seems natural that exposing 
people to others with different opinions can reduce the extent of disagreement within the group. 
When one looks at the form of the social cost c{y), however, there is something slightly counter- 
intuitive about the idea of adding edges to improve the situation: the social cost is a sum of 
quadratic terms, and by adding edges to G we are simply adding further quadratic terms to the 
cost. For this reason, in fact, adding edges to G can never improve the optimal social cost. But 
adding edges can improve the social cost of the Nash equilibrium, and sometimes by a significant 
amount — the point is that adding terms to the cost function shifts the equilibrium itself, which 
can sometimes more than offset the additional terms. For example, if we add a single edge from 
the center of the star in Figure [2] to one of the leaves, then the center will shift her opinion to 
2/3 in equilibrium, causing all the leaves to shift their opinions to 1/3, and resulting in a 0(n) 
improvement in the social cost. In this case, once the leader pays attention to even a single member 
of the group, the social cost improves dramatically. 

We focus on three main variants on this question: when all edges must be added to a specific 
node (as in the case when a site can modify the amount of attention directed to a media source 
or celebrity); when all edges must be added from, a specific node (as in the case when a particular 
media site tries to shift its location in the space of opinions by blending in content from others); 
and when edges can be added between any pair of nodes in the network (as in the case when a social 
networking site evaluates modifications to its feeds of content from one user to another [^119]). 

In Section H] we show that, in the previously discussed variants, the problem of where to add 
edges to optimally reduce the social cost is NP-hard. But we obtain a set of positive results as well, 
including a |-approximation algorithm when edges can be added between arbitrary pairs of nodes. 



^An Eulerian asymmetric directed graph is an Eulerian graph that does not contain any pair of oppositely oriented 
edges (i,j) and {j,i). 



and an algorithm to find the optimal amount of additional weight to add to a given edge. 

2 Undirected Graphs 

We first consider the case of undirected graphs and later handle the more general case of directed 
graphs. The main result in this section is a tight bound on the price of anarchy for the opinion- 
formation game in undirected graphs. After this, we discuss two slight extensions to the model: 
in the first, each player can put a different amount of weight on her internal opinion; and in the 
second, each player has several fixed opinions she listens to instead of an internal opinion. We show 
that both models can be reduced to the basic form of the model which we study first. 
For undirected graphs we can simplify the social cost to the following form: 

ciz) = '^{zi - Sif + 2 ^ Wij{zi-Zjf. 

i {i,j)eE,i>j 

We can write this concisely in matrix form, by using the weighted Laplacian matrix L of G. L 
is defined by setting Lj^j = Ylji^N(i)'^i,J ^"^^ ^iJ ~ ~^«,i- ^^ ^^^ ^'^^^ write the social cost as 
c{z) = z'^Az + \\z — s|p, where the matrix A = 2L captures the tension on the edges. The optimal 
solution is the y minimizing c(-). By taking derivatives, we see that the optimal solution satisfies 
{A + I)y = s. Since the Laplacian of a graph is a positive semidefinite matrix, it follows that A + 1 
is positive definite. Therefore, {A + I)y = s has a unique solution: y = {A-\- I)~^s. 

In the Nash equilibrium x each player chooses an opinion which minimizes her cost; in terms of 
the derivatives of the cost functions, this implies that c[{x) = for all i. Thus, to find the players' 
opinions in the Nash equilibrium we should solve the following system of equations: \/i {xi — Si) + 
SfGiVfj) '^i,j{^i ~ ^j) — 0- Therefore in the Nash equilibrium each player holds an opinion which is 
a weighted average of her internal opinion and the Nash equilibrium opinions of all her neighbors. 
This can be succinctly written as (L + I)x = {^A + I)x = s. As before ^A + / is a positive definite 
matrix, and hence the unique Nash equilibrium is x = {^ A + I)~^s. 

We now begin our discussion on the price of anarchy (PoA) of the opinion game — the ratio 
between the cost of the optimal solution and the cost of the Nash equilibrium. 

Our main theorem is that the price of anarchy of the opinion game is at most 9/8. Before 
proceeding to prove the theorem we present a simple upper bound of 2 on the PoA for undirected 
graphs. To see why this holds, note that the Nash equilibrium actually minimizes the function 
^"^(2^)2+11^;— s|p (one can verify that this function's partial derivatives are the system of equations 
defining the Nash equilibrium). This allows us to write the following bound on the PoA: 

PoA = ^ < 2(x^(i^)x+|k-s||2) 



c(y) c{y) 

2(y^(l^)y + ||y-s||2) 



< 



civ) 



< M^ = 2 

c(y) 

We note that this bound holds only for the undirected case, as in the directed case the Nash 
equilibrium does not minimize z'^{i2A)z + ||z — s|p anymore. 
We now state the main theorem of this section. 

Theorem 2.1 For any graph G and any internal opinions vector s, the price of anarchy of the 
opinion game is at most 9/8. 



Proof: The crux of the proof is relating the price of anarchy of an instance to the eigenvalues of its 
Laplacian. Specifically, we characterize the graphs and internal opinion vectors with maximal PoA. 
In these worst-case instances at least one eigenvalue of the Laplacian is exactly 1, and the vector of 
internal opinions is a linear combination of the eigenvectors associated with the eigenvalues 1, plus 
a possible constant shift for each connected component. As a first step we consider two matrices B 
and C that arise by plugging the Nash equilibrium and optimal solution we previously computed 
into the cost function and applying simple algebraic manipulations: 

c{y) = s^[(A + /)-! - If + {A + ir^A{A + I)-^]s 

^ V ' 

B 

c{x) = s^[{L + I)-' - If + {L + I)-'A{L + I)-']s. 

^ V ' 

c 

Next, we show that the matrices A,B,C are simultaneously diagonalizable: there exists an 
orthogonal matrix Q such that A = QA Q , B = QA Q and C = QA Q , where for a matrix 
M the notation A^ represents a diagonal matrix with the eigenvalues A^^ , • • • , A^ of M on the 
diagonal. 

Lemma 2.2 A,B and C are simultaneously diagonalizable by a matrix Q whose columns are eigen- 
vectors of A. 

Proof: It is a standard fact that any real symmetric matrix M can be diagonalized by an 
orthogonal matrix Q such that M = QA Q . Q's columns are eigenvectors of M which are 
orthogonal to each other and have a norm of one. Thus in order to show that A, B and C can be 
diagonalized with the same matrix Q it is enough to show that all three are symmetric and have 
the same eigenvectors. For this we use the following basic fact: 

// A is an eigenvalue of N, A is an eigenvalue of M and w is an eigenvector of both 
then: 

1. J is an eigenvalue of M^^ and w is an eigenvector of M^^ . 

2. A + A is an eigenvalue of N + M and w is an eigenvector of N + M. 

3. X^ • A^ is an eigenvalue of NM and w is an eigenvector of NM. 

From this we can show that any eigenvector of A is also an eigenvector of B and C. Recall that 
^ is a symmetric matrix, thus, it has n orthogonal eigenvectors which implies that A,B and C are 
all symmetric and share the same basis of eigenvectors. Therefore A,B and C are simultaneously 
diagonalizable. D 

We can now express the PoA as a function of the eigenvalues of B and C. By defining s' = Q'^s 
we have: 



PoA 



c{x) s'^Cs s^QA^'Q'^ 



s 



c{y) s^Bs s'^QABQTs 

The final step of the proof consists of expressing Ap and A^ as functions of the eigenvalues of 
A (denoted by Aj) and finding the value for Aj maximizing the ratio between Ap and \f . 



Lemma 2.3 maxj -^ < 9/8. The bound is tight if and only if there exists an i such that A, 



Af 
Proof: Using the basic facts about eigenvalues which were mentioned in the proof of Lemma [221 

we get: 



vB 



1 \^ 1.1 



Af = 1 - ^-— + ——A 



Ai + iy A, + 1 'Ai + 1 
A,- Aj A,- + Aj Aj 



,c 



(Ai + 1)2 (A. + 1)2 (A, + 1)2 (Ai + 1) 

/ \ 2 

1 . 1 



Ar = 1 - T^ 7 + T^ rXi 



iAi + iy iAi + 1 'iAi + 1 
A? ^ 4A, A2 + 4Ai 



(A, + 2)2 (A, + 2)2 (Ai + 2)2- 
We can now write Xf /Xf = </<(Aj), where i;^ is a simple rational function: 

(A2 + 4A)/(A + 2)2 (A2 + 4A)(A + 1) 



<t>{X) 



A/(A + 1) (A + 2)2A 

(A + 4)(A + 1) A2 + 5A + 4 



(A + 2)2 A2 + 4A + 4' 

By taking the derivative of (f), we find that (j) is maximized over all A > at A = 2 and (/>(2) = 9/8. 

The eigenvalues Aj are all non-negative, so it is always true that maxj </>(Aj) < 9/8. If 2 is 
an eigenvalue of A (and hence 1 is an eigenvalue of the Laplacian) then there exists an internal 
opinions vector s for which the PoA is 9/8. 

What is the internal opinions vector maximizing the PoA? To find it assume that the ith 
eigenvalue of the Laplacian equals 1. To get a PoA of 9/8 we should choose s[ = 1 and Vj / i s'- = 
to hit only Aj. By definition s' = Q s, and hence s = {Q )~^s'. Because Q is orthogonal, 
Q^ = Q~^] thus, s = Qs' = Vi, where vi is the eigenvector associated with Aj. In fact, any 
linear combination of the eigenvectors associated with eigenvalues and 1 where at least one of the 
eigenvectors of 1 has a nonzero coefficient will obtain the maximal PoA. D 

With Lemma 12.31 we have completed the proof of Theorem 12. 1[ D 

Corollary 2.4 We can scale the weights of any graph to make its PoA he 9/8. If a is the scaling 
factor for the weights, then the eigenvalues of the scaled A matrix are aXi . Therefore by choosing 
a = 1- for any eigenvalue other than we get that there exists an internal opinions vector for 
which the PoA is 9/8. 

2.1 Arbitrary Node Weights and Players with Fixed Opinions 

Our first extension is a model in which different people put different weights on their internal 
opinion. In this extension, each node in the graph has a strictly positive weight Wi and the cost 
function is: c{z) = y^[wi{zi — Sj) + N^ Wij{zi — Zj) ]. The bound of 9/8 on the PoA holds 

i jeN{i) 

even in this model. To see this, let w be the vector of node weights and d{w) be a diagonal 
matrix with the values of w on the diagonal. In terms of the scaled variables z = d{y/w)z, 
s = d{y/w)s and the scaled matrix A = d{^/w)~^Ad{^/w)~^, the cost takes the same form as 
before: c{z) = \\z — s\\'^ + z^ Az. We have therefore proved: 



Claim 2.5 The PoA of the game with arbitrary strictly positive node weights is bounded by 9/8. 

Next we show how to handle the case in which a subset of the players may have node weights 
of 0, which can equivalently be viewed as a set of players who have no internal opinion at all. We 
analyze this by first considering the case in which all non-zero node weights are the same; for this 
case we prove: 

Lemma 2.6 // every player has either weight 1 or on her internal opinion, then the PoA is 
bounded by 9/8. 

Proof: Let Z be the set of players who do not have an internal opinion. We define the following 
diagonal matrix R: Ri^i = for i G Z and Rjj = 1 for j ^ Z. We assume without loss of generality 
that Z ^ V since otherwise the PoA is 1. We can also assume without loss of generality that in 
the instance which maximizes the PoA each i ^ Z has an internal opinion of 0. Therefore we can 
express the social cost as c{z) = \\z — s\\'^ + z {A + R — I)z. Since the cost associated with all i ^ Z 
remains the same while for i ^ Z the cost of ||zi — Si|p = z? is countered by the —zf from the i*'* 
row of z {R — I)z. Similar to before we have that the optimal solution is y = (^ + R)^^s and the 
Nash equilibrium is x = (2^ + ^)"^^. Since any real vector is an eigenvector of R we have that 
{A + R — I), {A + R) and (2^ + -R) are simultaneously diagonalizable and therefore the same steps 
we took to prove Theorem 12.11 lead us to get a bound of 9/8 for the PoA. D 

By applying the change of variables from Claim 12.51 we can also handle non-zero arbitrary 
weights. 

In the second model we present, some nodes have fixed opinions and others do not have an 
internal opinion at all. We partition the nodes into two sets A and B. Nodes in B are completely 
fixed in their opinion and are non-strategic, while nodes in A have no internal opinion - they 
simply want to choose an opinion that minimizes their disagreement with their neighbors (which 
may include a mix of nodes in A and B). We can think of nodes in A as people forming their 
opinion and of nodes in B as news sources with a specific fixed orientation. We denote the fixed 
opinion of a node j G B hy Sj. The social cost for this model is: 



c(.z)= Yl {zi-Sjf + 2 



E ( 

(ij)G-E; (i,j)eE; 

ieAyG-B i,j£A;i>j 



Note that this clearly generalizes the original model, since we can construct a distinct node in 
B to represent each internal opinion. Next, we perform the reduction in the opposite direction, 
reducing this model to the basic model. To do this, we assign each node an internal opinion equal 
to the weighted average of the opinions of her fixed neighbors, and a weight equal to the sum of 
her fixed neighbors' weights. We then show that the PoA of the fixed opinion model is bounded by 
the PoA of the basic model and thus get: 

Proposition 2.7 The PoA of the fixed opinion model is at most 9/8. 

Proof: We reduce an instance of the fixed opinion game to an instance of the opinion game 
with arbitrary node weights as follows: We define the internal opinion of every player i £ A 
that has at least one neighbor in i? to be a weighted average of the opinions z's neighbors in B: 

Si = —^ — ^-^ — '■ — , where N^ii) is the set of i's neighbors in B. We also define node i's weight 

to be Wi = X^jgjv (i) '^i,r -^°^ ^ player i £ A who does not have any neighbors in B we simply 
define Wi = 0. We use G to denote the initial instance, and G' to denote the instance produced 



by the reduction. Let x be the Nash equiUbrium in G; then x is also the Nash equihbrium in G'. 
To see this, recall that in a Nash equilibrium each player's opinion is the weighed average of the 
opinions of all neighbors. Thus, 

In Claim [2^ below we show that cg{z) = cg'{z) + c for a positive constant c, hence, the optimal 
solution for G and G' is the same. Let y be this optimal solution and let x be G's and C's Nash 
equilibrium. By deriving the following bound we conclude the proof: 

PoAiG) = ^ < ^44±f < ^ < 9. 
cciy) CG'{y) + c CG'[y) 8 

Claim 2.8 cg^z) = cg'{z) + c where c is a positive constant. 

Proof: We show that cg{z) > cg'{z) and cg{z) — cg'{z) is constant. Observe that the only 
terms where the two costs differ are ones associated with the cost of the fixed opinions in G and 
the internal opinions in G' . Thus, it is enough to show that for every player i: 



Wijisj - Zif > Y^ Wij • ( ^ 



^ \ 2 



y^ Wi.iiSi - Zi)" > \ > Wi.i I • 1 -F^^ Z; 



j&Nsii) \i&NB(i) I V ^i&NB(t)^iJ 



By arranging the terms we get that the terms involving Zj's cancel out, hence what left to show is 
that: XljeAf U) ^ij'^? — — ^^ — ~ '' ■ "^^^ claim follows from the following computation: 



2 



yjeNgii) J jeNgii) jMNBii),j>k 

- Yl '^Ij^'j^ Yl WijWi^kis] + si) 



jeNsii) j,k€NB{i),j>k 



Yl ""'A 




n 



3 Directed Graphs 

We begin our discussion of directed graphs with an example showing that the price of anarchy can 
be unbounded even for graphs with bounded degrees. Our main result in this section is that we can 
nevertheless develop spectral methods extending those in Section [5] to find internal opinions that 
maximize the PoA for a given graph. Using this approach, we identify classes of directed graphs 
with good PoA bounds. 

In the introduction we have seen that the PoA of an in-directed star can be unbounded. As a 
first question, we ask whether this is solely a consequence of the unbounded maximum in-degree of 

9 



this graph, or whether it is possible to have an unbounded PoA for a graph with bounded degrees. 
Our next example shows that one can obtain a large PoA even when all degrees are bounded: we 
show that the PoA of a bounded degree tree can be G(n'^), where c < 1 is a constant depending on 
the in-degrees of the nodes in the tree. 

Example 3.1 Let G be a 2 -ary tree of depth log2fc n in which the internal opinion of the root is 

1 and the internal opinion of every other node is 0. All edges are directed toward the root. In the 
Nash equilibrium all nodes at layer i hold the same opinion, which is 2^*. (The root is defined 
to be at layer 0.) The cost of a node at layer i is 2 ■ 2~^*. Since there are 2 nodes at layer i, 

the total social cost at Nash equilibrium is V] 2^''2^~'^^ ^ ^ 5Z 2^''^'^'^\ For k > 2 this cost is 

i=l i=l 

2 T— 2 = 2 , _ . The cost of the optimal solution is at most 1; in fact it is 

very close to 1, since in order to reduce the cost the root should hold an opinion of e very close to 

k — 2 

0, which makes the root's cost approximately 1. Therefore the PoA is 0(n~^). It is instructive to 
consider the PoA for extreme values of k. For k = 2, the PoA is 0(logn), while for k = logn we 
recover the in-directed star from the introduction where the PoA is 0(n). For intermediate values 
of k, the PoA is 0(n^). For example, for k = 3 we get that the PoA is ©(ni). 

For directed graphs we do not consider the generalization to arbitrary node weights (along the 
lines of Section 12. ip , noting instead that introducing node weights to directed graphs can have a 
severe effect on the PoA. That is, even in graphs containing only two nodes, introducing arbitrary 
node weights can make the PoA unbounded. For example, consider a graph with two nodes i and 
j. Node i has an internal opinion of and a node weight of 1, while node j has an internal opinion 
of 1 and a node weight of e. There is a directed edge {i,j) with weight 1. There cost of the Nash 
equilibrium is 1/2, but the social cost of the optimal solution is smaller than e. To avoid this 
pathology, from now on we restrict our attention to uniform node weights. 

3.1 The Price of Anarchy in a General Graph 

For directed graphs the cost of the optimal solution and the cost of the Nash equilibrium are 
respectively c{y) = s Bs and c{x) = s Cs, as before. But now, C has a slightly more complicated 
form since L is no longer a symmetric matrix. Recall that matrix A is used in the social cost function 
to capture the cost associated with the edges of the graph (disagreement between neighbors). We 
define it for directed graph by setting Aij = —Wij — Wj^i for i ^ j and Ai^i = YljeN(i) ^*j' + 
X^|jUg7V(i)} ^i,j- "^^^ matrix A is the weighted Laplacian for an undirected graph where the weight 
on the undirected edge {i,j) is the sum of the weights in the directed graph for edges {i,j) and 
(j,i). We then define C = {{L + I)-^ - l)^ {{L + 1)"^ - /) + (L + I)~^A{L + I)~\ The price of 

s^Cs 
anarchy, therefore, is -tj^ — as before. The primary distinction between the price of anarchy in the 

s-^ Bs 
directed and undirected cases is that in the undirected case, B and C are both rational functions 

of A. In the directed case, no such simple relation exists between B and C, so that we cannot 

easily bound the generalized eigenvalues for the pair (and hence the price of anarchy) for arbitrary 

graphs. However, given a directed graph our main theorem shows that we can always find the 

vector of internal opinions s yielding the maximum PoA: 

Theorem 3.2 Given a graph G it is possible to find the internal opinions vector s yielding the 
maximum PoA up to a precision of e in polynomial time. 
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Proof: The total social cost is invariant under constant shifts in opinion. Therefore, without 
loss of generality, we restrict our attention to the space of opinion vectors with mean zero. Let 
us define a matrix P G M"^("-i) to have Pjj = 1, Pj+ij = —1, and Pij = otherwise. The 
columns of P are a basis for the space of vectors with mean zero; that is, we can write any such 
vector as s = Ps for some s. We also define matrices B = P^BP and C = P^CP, which are 
positive definite if the symmetrized graph is connected. The price of anarchy is then given by 
the generalized Rayleigh quotient Pc si^) — {s'^ C s) / {s'^ B s) . Stationary points oi P(j § satisfy the 
generalized eigenvalue equation (C — Pq g{s)B)s = 0. In particular, the price of anarchy is the 
largest generalized eigenvalue, and the associated eigenvector s* corresponds to the maximizing 
choice of internal opinions. 

The solution of generalized eigenvalue problems is a standard technique in numerical linear 
algebra, and there are good algorithms that run in polynomial time; see [131 §8.7]. In particular, 
because B is symmetric and positive definite, we can use the Cholesky factorization B = R R to 
reduce the problem to the standard eigenvalue problem {R~^CR~^ — XI){Rs) = 0. D 

3.2 Upper Bounds for Classes of Graphs 

Our goal in this section is rather simple: we would like to find families of graphs for which we can 
bound the price of anarchy. The main tool we use is bounding the cost of the Nash equilibrium by 
a function of a simple structure. By using a function that has a similar structure to the social cost 
function we are able to frame the bound as a generalized eigenvalue problem that can be solved 
using techniques similar to the ones that were used in proving Theorem 12.11 

Proposition 3.3 Let Q be a graph family for which there exists a j3 such that for any G ^ Q and 
any internal opinions vector s, we have c{x) < va.m.z{P{z^ Az) + \\z — s|p). Then, \/G G Q and 
opinion vectors s, PoA(G) < iVax j where A2 is the second smallest eigenvalue of A. 

Proof: Let y be the vector minimizing I3{z'^ Az) + \\z — s|p. We can derive the following bound 
on the price of anarchy: 

PoA{G) = ^ < P{f^v) + \\v-s\? ^ s^Gs 

c{y) ~ (y^^y) + l|y - •s|p s'^Bs' 

where G and B are defined similarly to the matrices in Theorem 1 2 . II and are simultaneously diago- 
nalizable. If A,- is an eigenvalue of A then XP = , , \ and Ap = J a\ ■ As before, the maximum PoA 

' ° « l+Ai « 1+pAi ' 

is achieved when Xf /Xf = ^\_g\, / 1,\. = gyji is maximized. The maximum here is taken over 
all eigenvalues different than as we know that the PoA for the internal opinions vector associated 
with eigenvalue (which is a constant vector) is 1. Therefore, the maximizing eigenvalue is A2. 

D 

An immediate corollary is that if there exists a /3 as in Proposition 13.31 then the PoA is bounded 
by this (3. 

We say that a bounded degree asymmetric expander is an unweighted directed graph that does 
not contain any pair of oppositely oriented edges {i,j) and {j,i), and whose symmetrized graph 
has maximum degree A and edge expansion a. We show: 

Claim 3.4 For a bounded degree asymmetric expander the PoA is bounded by 0(A^/a^). 

Proof: For an asymmetric graph, the matrix A is simply the Laplacian of the underlying graph; 
this is why we require in the claim that the graph is asymmetric. 
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If A is the maximum degree, then we have A2 < A„ < A. We also have that A2 > a^/2A [7]. 
We can now use this to bound the PoA in terms of the graph's expansion as fohows: 



/3 + /3A2 ^ /3 + /3A2 ^ I + A2 ^ 2A(1 + A) 



1 + /3A2 



/3A2 



A, 



a" 



0{/^^/a^). 



U 
The next natural question is for which graph families such a /3 exists. Intuitively, such a /3 
exists whenever the cost of the Nash equilibrium is smaller than the cost of the best consensus — 
that is, the optimal solution restricted to opinion vectors in which all players hold the same opinion 
(constant vectors). This is true since the function I3{z Az) + ||z — s|p is the social cost function of 
a network in which the weights of all edges have been multiplied by (3. However using this intuition 
for finding graph families for which (3 exists is difficult and furthermore does not help in computing 
the value of j3 (or a bound on it). Hence, we take a different approach. In Lemma [3. 5 1 we introduce 
an intermediate function g{-) with the special property that its minimum value is the same as the 
cost of the Nash equilibrium. By showing that there exists a /3 such that g{z) < f3z'^Az+\\z — s\\'^ we 
are able to present bounds for Eulerian bounded-degree graphs and additional bounds for Eulerian 
bounded-degree asymmetric expanders. As a first step, we use Schur complements to prove the 
following: 



Lemma 3.5 Let g{z) = z'^Mz + 



with M = (I — C) ^ — I. If {I — C) is nonsingular then 



for the Nash equilibrium x, we have Ta.m.zg{z) = c{x). 

Proof: The social cost is a quadratic function of the expressed opinion vector and the internal 
opinion vector: 



c{z) 



z'^Az + 



A + I 
-I 



I 



To compute the socially optimal vector, we minimize this quadratic form in z and s subject to 
constraints on s. This yields c(y) = s^Bs, where the matrix 

B = {{A + /)-! - If + {A + I)-^A{A + /)-! = I-{A + /)-i 

is a Schur complement in the larger systeixo. Schur complements typically arise in partial elim- 
ination of variables from linear systems. In this case, we have eliminated the z variables in the 
stationary equations for a critical point in the extended quadratic form. 

Now consider the Nash equilibrium. As we assume that (/ — C) is invertible, we can define 

M = [I-C)-^ -I. 

The matrix M is symmetric and positive semidefinite, with a null space consisting of the constant 
vectors. That is, we can see M as the Laplacian of a new graph. By design, C = I — {M + I)~^, 
so we can mimic the construction above to express C as a Schur complement in a larger system. 
Thus, the social cost of the Nash equilibrium can be written 

T 
c{x) = min 



M + I 
-I 



which is the optimal social cost in the new network. 

We then complement the lemma by showing that for Eulerian graphs (/ 
and furthermore the matrix M has a nice structure: 



D 
C) is nonsingular 



Recall that the Schur complement of the block A of the matrix 



is D - CA~^B. 
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Claim 3.6 For Eulerian graphs M = A + LL^ . 
Proof: We denote L = L + I and A = A + I then: 

I-C = I-{L-^-lf{L-^-I)-L-^{A-I)L~^ 
= L-^ + L-^ -L-^AL-^. 

We use the fact that for Eulerian graphs A = L + L-^ which implies that A = L + L?^ — / to simplify 
I-C: 

I-C = L-^ + L-^ - L-^ [L + L^ - 1)1-^ 
= L-^L-\ 

We have that M = {L + I){L + I)^ — I = A + LL^ . Let us understand what the matrix LL^ 
looks like. On the diagonal we have [LL-^]j^j = df + di where di is the degree of node i and off the 
diagonal [LL'^jij = diLj^i + djLij + Y.k^i,j{Li,kLj,k) = diLj^i + djLij + \N{i) D N{j)\. D 

Recall that A is the he maximum degree of an Eulerian graph. We are now ready to prove the 
following proposition: 



Proposition 3.7 For Eulerian graphs c(x) < (A + l){z'^Az) + \\z — s\ 



|2 



Proof: By Lemma 13.51 and Claim 13.61 we have that for Eulerian graphs c{x) = min^ g{z) = 
mmzZ^{A + LL'^)z + ||z — s|p. What remains to show is that for /3 = A + 1 it holds that 
g{z) < f^z'^Az + \\z — s|p. After some rearranging this boils down to showing that the following 
holds z'^LL'^z < (/3 - l)z'^Az 

Note that A is the Laplacian for a symmetrized version of the graph; assuming this graph is 
connected (since otherwise we can work separately in each component), this means A has one zero 
eigenvalue corresponding to the constant vectors, and is positive definite on the space orthogonal 
to the constant vector. Similarly, LL^ has a zero eigenvalue corresponding to the constant vectors, 
and is at least positive semi-definite on the space orthogonal to the constant vectors. Since A is 
positive definite on the space of nonconstant vectors, the smallest possible /3 can be computed via 
the solution of a generalized eigenvalue problem 

z^LL^z 
p = 1 + max — TfT-. — . 

z^ae Z^ Az 

In the case of an unweighted graph, one get a bound via norm inequalities. Using the fact that 
the graph is Eulerian, L^ is also a graph Laplacian, and we can write 

n 

so 

Similarly, we expand the quadratic form tt Az into 

z^ Az = ^{wij + Wj^i){zi - Zjf = Y2i j "^^jA^i - ^jY 
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Now, recall that in general [^j=iXj] < d'^-^x^, which means that in the unweighted case 
X]?=i Wj^i{zi - Zj)] < di ( X]?=i Wj^iizi - Zj)"^ ) . where di = Yl- Wj^i is the in-degree or out-degree. 



Therefore, 

Z^LL^Z ^ Er=l (^i E"=l Wj^i{Zi - Zjf ^ 
Z^ ^Z Ei=l Ei=l WjM - ZjY 

So for a general Eulerian graph, /3 < 1 + A. 

D 

We observe that for a cycle the bound of 2 on the price of anarchy is actually tight: 

Observation 3.8 The PoA of a directed cycle is bounded by 2 and approaches 2 as the size of the 
cycle grows. 

Proof: For a cycle it is the case that A = LL ; therefore g{z) = 2(z Az) + \\z — s|p, and hence 
the bound assumed in Proposition 13.31 is actually a tight bound. In order to show that the PoA 
indeed approaches 2 we need to show that A2 approaches as the size of the cycle grows. The fact 
that A is the Laplacian of an undirected cycle comes to our aid and provide us an exact formula 
for A2: A2 = 2(1 — cos(— )) (where n is the size of the cycle), and this concludes the proof. D 

For general Eulerian graphs we leave open the question of whether the bound of A + 1 is a tight 
bound or not. Indeed, it is an intriguing open question whether there exists a Eulerian graph with 
PoA greater than 2. 

4 Adding Edges to the Graph 

The next thing we consider is the following class of problems: Given an unweighted graph G and a 
vector of internal opinions s, find edges E' to add to G so as to minimize the social cost of the Nash 
equilibrium. We begin with a general bound linking the possible improvement from adding edges 
to the price of anarchy. Let G be a graph (either undirected or directed). Denote by cg(-) the cost 
function and by x and y the Nash equilibrium and optimal solution respectively. Let G' be the 

Cr^(x) Cf~'(x] ct~*(xi 

graph constructed by adding edges to G. Then: — - < — - < — -— = PoA(G). To see why 

CG'[x') CG'[y') cciy) 

this is the case, we first note that cq' {y') < cq' (x') since the cost of the Nash equilibrium cannot 
be smaller than the optimal solution. Second, cciy) < cc'iy') simply because cg'(-) contains more 
terms than cg'(-). Therefore we have proved the following proposition: 

Proposition 4.1 Adding edges to a graph G can improve the cost of the Nash equilibrium, by a 
multiplicative factor of at most the PoA of G. 

We study three variants on the problem, discussed in the introduction. In all variants, we seek 
the "best" edges to add in order to minimize the social cost of the Nash equilibrium. The variants 
differ mainly in the types of edges we may add. 

Adding edges from a specific node 

First, we consider the case in which we can only add edges from a specific node vu. Here we imagine 
that node w; is a media source that therefore does not have any cost for holding an opinion, and so 
we will use a cost function that ignores the cost associated with it when computing the social cost. 
Hence, our goal is to find a set of nodes F such that adding edges from node w to all the nodes in 
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F minimizes the cost of the Nash equihbrium while ignoring the cost exhibited by w. By reducing 
the subset sum problem to this problem we show that: 

Proposition 4.2 Finding the best set of edges to add from a specific node w is NP-hard. 

Proof: Denote hy G + F the graph constructed by adding to G edges from w to all nodes in 
F. Our goal is to find a set F minimizing CG+pix), where x is a Nash equilibrium in the graph 
G + F and c denotes the total cost of all nodes in x except for node w. We show that finding 
this set is NP-hard by reducing the subset sum problem to this problem. Recall that in the subset 
sum problem we are given a set of positive integers oi, . . . , a„ and a number t. We would like to 
know if there exists any subset S such that ^,^5 Oj = t. Given an instance of the subset problem, 
we reduce it to the following instance of the opinion game. The instance conatins an in-directed 
star with n peripheral nodes that have an internal opinion of and a center node w which has an 
internal opinion of 1 and n isolated nodes that have internal opinions of — y- 

Lemma 4.3 For the graph G and the vector of internal opinions s defined above, there exists a set 
F such that cg+f{x) = if and only if the answer to the subset problem is yes. 

Proof: As seen in the introduction, in the Nash equilibrium each one of the peripheral nodes 

holds an opinion of ^x^. Node w hold an opinion of x^ = — — - — . Therefore the cost of the 

Nash equilibrium in G + F is: 

cg+f{x) = n ( {-Xw - of + [xw - -Xwf ] =2n' ^^ 



2 "^ -. ■ V - 2 "'V V 2(1 + |F|) 

Clearly the cost is nonnegative as it is a sum of quadratic terms; moreover it equals if and only if 
XljeF ^j ~ ~^- Defining F' = {j £ F\sj < 0}, we have "^j^pi Sj = —1. By the reduction we have 
that ^j^pi —-f = —1; if we multiply by —t we get that YljeF' '^j ~ * implying that there exists a 
solution to the subset sum problem. D D 

Adding edges to a specific node 

Next, we consider the case in which we can only add edges to a specific node. We can imagine 
again that node w is a media source; in this case, however, our goal is to find the best set of people 
to expose to this media source. By reducing the minimum vertex cover problem to this problem 
we show that: 

Proposition 4.4 Finding the best set of edges to add to a specific node w is NP-hard. 

Proof: Given an instance of the minimum vertex cover problem, consisting of an undirected 
graph G' = {V , E'), we construct an instance of the opinions game as follows: 

• For each edge {i,j) G E' we create a vertex Vij with internal opinion 1. 

• For every Vij we create an in-directed star with 24 peripheral nodes that have an internal 
opinion of 0. We later refer to node Vij and all the nodes directed to it as Vij 's star. 

• For each vertex i £ V' we create a vertex m with internal opinion 1. 

• For each edge (i,j) G E' we create directed edges {vij,Ui) and {vij,Uj). 
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• We create an isolated node w with internal opinion —3. 

Let T be the set of vertices such that adding edges from all the nodes in T to node w minimizes 
the cost of the Nash equilibrium. Denote by G + T the graph constructed by adding to G edges 
from all nodes in T to w. Observe that T cannot contain any nodes with internal opinion of as 
adding an edge from a node with internal opinion to m; which has internal opinion —3 can only 
increase the cost of the Nash equilibrium. Thus, T contains only vertices of type Vij and Uj. In 
the table in Figure [3] we compute Vij's opinion in the Nash equilibrium and the cost of its star as 
a function of which vertices that influence Vij are in T. For example in the first row we consider 
the case in which Vij,Ui,Uj ^ T. In this case, Vij's opinion is (1 + 1 + l)/3 = 1 and the cost of its 
star is 2 ■ 24 = 12. We use the costs in this table to reason about the structure of T and the cost 
of the Nash equilibrium in G + T. 





Configuration 


Ujj's opinion 


Ujj's star cost 


1 


Vij,Ui,Uj ^ T 


1 


12 


2 


Vij £ T,Ui,Uj ^ T 





12 


3 


Vi,j,Ui £ T,Uj ^ T 


-1/2 


14 


4 


Vij,Ui,Uj £ T 


-1 


20 


5 


Vij,Uj ^T,Ui £T 


1/3 


4 


6 


ViJ ^ J^ lUi^Uj £ 1 


-1/3 


4 



Figure 3: The total cost of Wjj's star for different configurations 

In Lemma [4.5l we show how to construct from T a set T' such that cg+t'{x') = cg+t{x) and T' 
is a pseudo vertex cover. We say that a set T' is a pseudo vertex cover if it obeys two properties: 
first, it contains only vertices of the type Uj. Second, the vertices in V' corresponding to the Uj's 
in V constitute a vertex cover in G' . 

Next, we consider the cost of the Nash equilibrium in the graph G + S where S is a pseudo 
vertex cover: By the table in Figure [3] we have the cost associated with every fij's star is 4. This 
is by the fact that S* is a pseudo vertex cover and hence the only applicable cases are 5 and 6, in 
both cases the total cost of Vij^s star is 4. Also, note that the cost for each m £ S is 8. Hence, the 
total cost of the Nash equilibrium for network G + S" is f{S) = 4|i?| + 8\S\. By construction, T' 
is a pseudo vertex cover and it also minimizes /(•), since cg+t{x) = cg+t'{x') = 4|£'| + 8|r'| and 
T is optimal. Therefore T' corresponds to a minimum vertex cover in G' . A key element in this 
reduction is the property that the cost of Vijs star is the same, whether Ui £ T' or both Ui and Uj 
belong to T' . 

Lemma 4.5 There exists a pseudo vertex cover T' such that CG+T'i^') = cg+t{x) 

Proof: First, we obtain T" by removing from T all vertices of type Vij. We have that cg+t" (x") < 
cg+t^x) since by examining the table in Figure [3] we observe that including vertices of type Vij in 
T" can only increase the cost of the Nash equilibrium. Since T is optimal, it has to be the case that 
CG+T"ix") = CG+rix)- Next, to get T' we take T" and for each vertex vij such that Ui,Uj ^ T" 
we add Ui to T'. By adding these vertices we have not increased the cost since in the worst case 
Wjj's star and Ui have a total cost of 12 which is the same as their previous total cost. As before 
by the optimality of T we could not have reduced the cost by adding the vertices, therefore it still 
holds that cg+t'{x') = cg+t{x)- To complete the proof observe that by construction T' is a pseudo 
vertex cover. D 

D 
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Adding an arbitrary set of edges 

In the last case we consider, which is the most general one, we can add any set of edges. For this 
case we leave open the question of the hardness of adding an unrestricted set of edges. We do show 
that finding the best set of k arbitrary edges is NP-hard. This is done by a reduction from /c-dense 
subgraph [lOj : 

Proposition 4.6 Finding a best set of arbitrary k edges is NP-hard. 

Proof: We show a reduction from the "Dense fc-Subgraph Problem" defined in [10]: given an 
undirected graph G' = {V', E') and a parameter k, find a set of k vertices with maximum average 
degree in the subgraph induced by this set. Given an instance of the "Dense fc-Subgraph Problem" 
we create an instance of the opinion game as follows: 

• For every edge {i,j) G E' we create a node vij with internal opinion 0. 

• For every vertex i ^V we create a node Ui with internal opinion 1. 

• For every Vij we add directed edges {vij,Ui) and {vij,Uj). 

• For every Uj we create an in-directed star with 20 peripheral nodes that have an internal 
opinion of 0. 

• Finally, we create a single isolated vertex w with internal opinion -1. 

The proof is composed of two lemmas. In Lemma 14.71 we show that all edges in the minimizing set 
are of type {ui,w). Then we denote by T the set of nodes of type Ui such that adding an edge from 
each one of these nodes to w minimizes the cost, and in Lemma 14.81 we show that T is a A: densest 
subgraph. 

Lemma 4.7 The best set of edges to add contains only edges from nodes of type Ui to w. 

Proof: Our first observation is that any edge which is not from nodes of type Ui affects the cost 
of at most one node. This is simply because all nodes in the graph, if affected by any node at 
all, are affected by nodes of type ui. The cost of each one of the nodes in the graph in the Nash 
equilibrium is at most 1, and therefore the improvement in the cost from adding any such edge is 
at most 1. On the other hand, adding an edge from nodes of type Ui to w reduces the cost by at 
least 220 — 2(1 — 0)^ = 8. It is easy to verify that adding edges from nodes of type Ui to other 
nodes has a smaller effect on z's cost. D 

Lemma 4.8 The previously defined set T is a solution to the dense k-subgraph problem. 

Proof: The key point is the fact that the cost associated with a node of type Vij is if and only 
if both Ui and Uj are in T; otherwise this cost is exactly |. When Uj G T, the opinion of Ui in the 
Nash equilibrium is since it is averaging between 1 and —1. Therefore node t'ij's associated cost 
in the Nash equilibrium is: 

• - if both Ui and Uj are in T - since f j.j holds opinion 0. 

• 3 - if both Ui and Uj are not in T - since Vi j's opinion is g and therefore the cost is (0 — 3)^ + 
2(1-1)^ = 1. 

• 3 - if only one of Uj, Uj is in T - then fj j's opinion is 3 and therefore the cost is (0 — 3)^ + 
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Hence to minimize the cost of the Nash equihbrium we should choose a set T maximizing the 
number of nodes of type Vij for which both Uj and Uj are in T. In the graph G' from the /c-dense 
subgraph problem that set T is a set of vertices and what we are looking for is the set T with an 
induced graph that has the maximum number of edges. By definition this set is exactly a fc-densest 
subgraph. D D 

Finding approximation algorithms for all of the problems discussed in propositions 14.21 14. 4^ 
and 14.61 is an interesting question. As a first step we offer a |-approximation for the problem of 
optimally adding edges to a directed graph G — a problem whose hardness for exact optimization 
we do not know. The approximation algorithm works simply by including the reverse copy of every 
edge in G that is not already in G; this produces a bi-directed graph G'. 

Claim 4.9 cg'{x') < ^cdy). 

Proof: By Theorem 12.11 we have that cg'{x') < |cG"(y')- Also notice that in the worst case, in 
order to get from G to G', we must double all the edges in G. Therefore CG>{y') < 2cG{y)- By 
combining the two we have that cg'{x') < jCG{y)- D 

For weighted graphs we can also include reverse copies of edges that do appear in G and hence 
achieve an approximation ratio of 2 for analogous reasons. 

4.1 Adding a Single Weighted Edge 

We now consider how to optimally choose the weight to put on a single edge {i,j), to minimize the 
cost of the Nash equilibrium. Suppose we add weight p to the edge («,j). The modified Laplacian 
is L' = L + pei{ei — ej) , where Cj is the ith vector in the standard basis. The modified Nash 
equilibrium is x' = {L' + /)~ s = {{L + /) + pei{ei — Cj) )~ s. 

Using the Sherman-Morrison formula for the rank-one update to an inverse |13t §2.1.3], we have 



/ 

X 



p{Xi - Xj) 



.1 + p{vi,i -■Vj,. 

where Vi = {L -\- I)^^ei is the influence of Si on the Nash opinions in the original graph. Therefore, 
Vi gives the direction of change of the Nash equilibrium when the weight on (i, j) is increased: the 
equilibrium opinions all shift in the direction of Vi. We prove the following key properties of this 
influence vector Vi: 

Lemma 4.10 The entries of Vi = {L + I)~^ei lie in [0,1], and Vi^i is the unique maximum entry. 

Proof: The influence vector Vi is simply the Nash equilibrium for the internal opinion vector e^. 
The Nash equilibrium is the limit of repeated averaging starting from the internal opinions, and 
the average of numbers in [0, 1] is in [0, 1]. Thus the entries of Vi are in [0, 1]. 

We show that Vi^i is the maximal entry by contradiction. Suppose Vij is maximal for some 
j / i. Because L -|- / is nonsingular, Vi cannot be the zero vector, so Vij > 0. The equilibrium 
equations for j can be written 

_ J2k&N{j)'"^j,k'"i,k 



1 + J2keN{j) '^j,k 
Yjk&Njj) '^hk 



^ / Y.k&N{j)'^hk \ 

< ^^ — ^^ max Vik < max Vi k 
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where the final inequahty is strict if Vi^k 7^ for any k G ^ij)- But vt^k 7^ for some k G ^ij), 
since otherwise Vij would be zero. Therefore, there must be some k G N{j) such that Vi^k > Vij, 
which contradicts the hypothesis that Vij is maximal. D 

We now show how to choose the optimal weight p to add to edge {i,j) to best reduce the social 
cost of the Nash equilbrium. 

Theorem 4.11 The optimal weight p to add to the edge {i,j) can be computed in polynomial time. 



Proof: Note that 



■' ' \ 1 + p{Vi 



p{Vi,i 



Xi 



1 + p{Vi^i -Vij)' 

and we can write the new Nash equilibrium as x' = x — (pVi, where 



„/ ™/ 



p{Xi -Xj) N^i ~^i / / /< 
'- - p{Xi - Xj) '- = p{Xi - X, 



1 + p{Vi,i - Vij) Xi- Xj * ^ ' 

For small values of p, we have that (p = p{xi — Xj) + 0{p^)] and as p — t- oo, we have that (p ~^ 
0max = (xi — Xj)/{vi^i — Vij) and x[ — x' — )■ 0. Thus, adding a small amount of weight to edge (i, j) 
moves the Nash equilibrium in the direction of the influence vector Vi proportional to the weight 
p and the discrepancy Xj — Xj ; while adding larger amounts of weight moves the Nash equilibrium 
by a bounded amount in the direction of the influence vector Vi, with the asymptotic limit of large 
edge weight corresponding to the case when i and j have the same opinion. 

What does adding a weighted edge between i and j do to the social cost at Nash equilibrium? 
In the modifled graph, the social cost is 

T ^^ , „/ ^ \2 , 11 i|2 



c'{z) = z Az + p{zi — Zj) +\\z 



s 



At the new Nash equilibrium, we have 

c'(x') = x'^Ax' + p{x'i - x'jf + ||x' - s|p 
= x' Ax' + 0(x^ — x'j) + \\x' — s\\ . 

Because x' is a linear function of (/), the above shows that c'(x') is a quadratic function of (j), which 
we can simplify to c'(x') = Qjj^^ — 2/3jj0 + c(x), where 

aij = vf{A + I)vi - {vi^i - Vij) 

f3ij = vj {{A + I)x - s)--{xi- Xj). 

The range of possible values for (j) is between (corresponding to p = 0) and 0max (corresponding 
to the limit as p goes to inflnity). Subject to the constraints on the range of 0, the quadratic in (j) 
is minimal either at 0, at ^max, or at /3ij/aij (assuming this point is between and 0max)- We can 
therefore determine the optimal weight for a single edge in polynomial time. D 
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Note that the above computations also give us a simple formula for the gradient components 
7jj corresponding to differentiation with respect to Wij: 

djc'ix')] _ d[c'{x')] # _ _ _ 

^''- dp ~ # dp~ '''^^' ^'> 

= {xi - Xj)'^ - 2{xi - Xj)vf{{A + I)x - s). 

The residual vector {A + I)x — s measures the extent to which x fails to satisfy the equation for 
the socially optimal opinion y. If this vector is large enough, and if the influence vector Vi is 
sufficiently well aligned with the residual, then adding weight to the (i,j) edge can decrease the 
social cost at Nash equilibrium. Thus, though computing a globally optimal choice of additional 
edge weights may be NP-hard, we can generally compute locally optimal edge additions via the 
method of steepest descent. 
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